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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- if the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)[>3 Responsive to communication(s) filed on 10 March 2004 . 
2a)D This action is FINAL. 2b)M This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) £3 Claim(s) 1-23 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 1-23 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) [3 The drawing(s) filed on 04 April 2000 is/are: a)[x] accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



Specification 



1 . The amendment filed on March 10, 2004 in paper number 7 overcomes all 
previous objections to the specification, these objections are therefore withdrawn. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 



3. Claim1-3, 6, 8, 10-12, 16, 20 and 21 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Wilder et al. (US 5,262,871). 

[claim 1] 

4. In regard to claim 1 , note that Wilder et al. discloses a vision system for imaging 
a scene using a dynamically reconfigurable photodetector array (Figure 1, Item 10) 
comprising: a video camera (Figure 1) having at least one reconfigurable photodetector 
array capable of imaging a scene (Figure 1 , Item 10); means for controlling 
characteristics (i.e. which pixels will be read-out and what resolution the array will be 
read-out at) of imaging by the photodetector array (Figure 1 , Items 12 and 14); and a 
computer system for receiving signals from the photodetector array representing the 
scene imaged by the photodetector array and sending signals to the controlling means 
to configure the characteristics of imaging by the photodetector (Figure 1 , Item 18; 



States. 
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Column4, Line 45 - Column 5, Line 1 1 ). 
[claim 2] 

5. In regard to claim 2, note that Wilder et al. discloses a photodetector array that 
provides signals representing a frame with one or more regions of interest or "windows" 
having pixels (Column 6, Lines 3-46, specifically the "multiple region of interest" mode). 



6. In regard to claim 3, note that Wilder et al. discloses a photodetector array that 
further comprises means for controlling the resolution of the pixels in each of the 
regions of interest or "windows" (Column 6, Lines 3-46; specifically the "combination of 
both the VR and MRI" mode). 



7. In regard to claim 6, note that Wilder et al. discloses controlling means which . 
represent a controller located on the photodetector array (Figure 2; Column 5, Lines 23- 



8. In regard to claim 8, note that Wilder et al. discloses a system wherein the 
computer system is integrated into the video camera (Figure 1). 

[claim 10] 

9. In regard to claim 1 0, note that Wilder et al. discloses a computer system that 
sends signals to the controlling means representing window request commands that 
contain information used to dynamically reconfigured one or more of the photodetector 



[claim 3] 



[claim 6] 



65). 



[claim 8] 
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array's imaging characteristics (Column 4, Line 45 - Column 5, Line 11). 
[claim 11] 

10. In regard to claim 1 1 , note that Wilder et al. discloses characteristics which 
represent spatial (i.e. resolution) and temporal (i.e. when the pixels will be read-out) 
parameters (Column 4, Line 67 - Column 5, Line 11). 

[claim 12] 

11. In regard to claim 12, note that Wilder et al. discloses a photodetector array that 
contains a plurality of pixels that have fixed dimensions (Column 19, Lines 1-13). 
[claim 16] 

12. In regard to claim 16, note that Wilder et al. discloses a system wherein said 
computer system and said video camera are part of a closed-loop interactive system 
(Figure 1). 

[claim 17] 

13. In regard to claim 17, note that Wilder et al. discloses a computer system which 
is capable of analyzing video imagery for target objects and determining the necessary 
position, size, shape, resolution and frame rate of multiple, overlapping windows within 
the vision system's field of view (Column 6, Lines 48-64). 

[claim 20] 

14. In regard to claim 20, note that Wilder et al. further discloses means for 
generating a window request command to the video camera identifying the 
characteristics (Column 4, Line 45 - Column 5, Line 11). 

[claim 21] 
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15. In regard to claim 21 , note that Wilder et al. further discloses means for 
generating a window request command to the video camera identifying the 
characteristics, in which the characteristics represent a position, size, shape, resolution 
and frame rate of multiple windows (Column 4, Line 45 - Column 6, Line 64). 

16. Claim 1 is rejected under 35 U.S.C. 102(b) as being anticipated by Elabd et al. 
(US 5,196,939). 



17. In regard to claim 1 , note that Elabd et al. discloses a vision system for imaging a 
scene using a dynamically reconfigurable photodetector array (Figure 4) comprising: a 
video camera (Figure 1 , Item 1 ) having at least one reconfigurable photodetector array 
capable of imaging a scene (Figure 4); means for controlling characteristics (i.e. which 
pixels will be read-out) of imaging by the photodetector array (Figure 4, Items 33 and 
35; Column 4, Lines 28-41); and a computer system for receiving signals from the 
photodetector array representing the scene imaged by the photodetector array and 
sending signals to the controlling means to configure the characteristics of imaging by 
the photodetector (Figure 1 , Item 5; Column 3, Line 60 - Column 4, Line 5). 

Claim Rejections - 35 USC § 103 

1 8. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 



[claim 1] 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

19. Claims 5 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wilder et al. (US 5,262,871) in view of Yoshimura et al. (US 6,556,241). 

[claim 5] 

20. In regard to claim 5, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system, which further comprises a client-server interface between 
said computer system and said controlling means. Yoshimura et al. discloses a remote- 
controlled camera picture broadcast system in which a client-server interface exists 
between a client computer and the camera controller so that users can control the 
camera system from a remote location (Abstract). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to combine the remote control 
of Yoshimura et al. with the system of Wilder et al. to allow a client-server relationship 
between the computer system and the controlling means so that the camera can be 
controlled remotely. 

[claim 9] 

21 . In regard to claim 5, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system, which further comprises a computer system that is 
separate from the video camera. Yoshimura et al. discloses a remote-controlled 
camera picture broadcast system in which a client-server interface exists between a 
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client computer and the camera controller so that users can control the camera system 
from a remote location (Abstract). It would have been obvious to one of ordinary skill in 
the art at the time the invention was made to combine the remote control of Yoshimura 
et al. with the system of Wilder et al. to allow a computer to be separately located from 
the camera so that the camera can be controlled remotely. 



22. Claims 4, 7, 13, 19, 22 and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Wilder et al. (US 5,262,871). 

[claim 4] 

23. In regard to claim 4, Wilder et al. discloses a system which meets the 
requirements as set forth in claim 2 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system wherein one or more of the windows overlap in the frame. 
However, it is noted that Wilder et al. discloses that the readout can be performed on 
"any region or regions of the image sensor" (Column 6, Lines 41-44). Therefore, It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to allow windows to overlap when reading out multiple regions of interest to avoid 
losing image data due to overlapping between the regions of interest. 

[claim 7] 

24. In regard to claim 7, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system in which said controlling means represents a logic device 
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separate from said photodetector array. However, it is well known in the electronics art 
that control circuitry can be either integrated on the same chip or made separate as a 
different chip so long as the two chips remain in electrical contact with each other 
(Official Notice). Therefore, It would have been obvious to one of ordinary skill in the art 
at the time the invention was made to move the control circuitry for the photodetector 
array onto a separate chip in order to be able to replace one device without the added 
cost of replacing the other, 
[claim 13] 

25. In regard to claim 13, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. It is further noted that Wilder 
discloses a system which uses a CMOS photodetector (Column 18, Lines 36-43). 
Therefore, it can be seen that Wilder et al. lacks a system including a photodetector 
which is responsive to radiation in the visible spectral range. However, it is well known 
in the art to use photodetectors which is responsive to radiation in the visible spectral 
range to reproduce scenes as they would have been seen to a human viewer (Official 
Notice). Therefore, It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to make the CMOS photodetector of Wilder et al. 
responsive to radiation in the visible spectral range to reproduce images as they would 
have been seen by a human viewer. 

[claim 19] 

26. In regard to claim 19, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 2 as discussed above. Therefore, it can be seen that 
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Wilder et al. lacks a system wherein said computer system further comprises a user 
interface enabling a human operator to analyze video imagery for target objects and 
determine the necessary position, size, shape, resolution, frame rate and spectral 
content of multiple windows within said visions system's field of view. However, it is 
well known in the image recognition art that computer artificial intelligence is not as 
good as human intelligence when it comes to determining complex patterns in images 
(Official Notice). Therefore, It would have been obvious to one of ordinary skill in the art 
at the time the invention was made to use a human being to analyze video imagery for 
target objects as claimed to avoid false negatives and false positives in object tracking 
determinations, 
[claim 22] 

27. In regard to claim 22, note that Wilder et al. discloses a method of tracking 
objects in a scene comprising a frame of windows comprising the steps of locating at 
least one object to be tracked in one of the windows in a low resolution (Column 6, 
Lines 48-57); and forming one or more windows having the object in a high resolution 
(Column 6, Lines 55-59). Therefore, it can be seen that Wilder et al. lacks a tracking 
method which identifies the object in the windows of high resolution. However, it is well 
known in tracking systems to identify objects which are being tracked in order to 
determine whether further actions need to carried out (Official Notice). Therefore, It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to identify the object being tracked in the high resolution windows of Wilder et al. 
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to determine whether further actions need to be carried out. 
[claim 23] 

28. In regard to claim 23, note that Wilder et al. discloses a system creates windows 
of high resolution for each region of interest or "target" (Column 6, Lines 55-59). 

29. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Wilder et 
al. (US 5,262,871 ) in view of Kimata (US 5,095,21 1 ). 

[claim 14] 

30. In regard to claim 14, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system wherein said photodetector array represents a device 
responsive to infrared wavelengths. Kimata discloses an infrared image sensor, which 
is responsive to infrared wavelengths, and thereby capable of detecting objects that 
conventional visible light image sensors may miss. It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to use the infrared image 
sensor of Kimata with the system of Wilder et al. so as to detect objects using infrared 
which conventional visible light image sensors may miss. 

31 . Claim 1 5 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Wilder et 
al. (US 5,262,871) in view of Fossum et al (US 5,236,871). 

[claim 15] 
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32. In regard to claim 15, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system wherein said photodetector array is bonded to a 
complementary metal oxide semiconductor read-out integrated circuit. Fossum et al. 
teaches a photodetector array which is bonded onto an integrated read-out circuit so as 
to use the proper material for optimum performance of the photodetector and read-out 
circuit individually (Abstract; Figure 5), it is also noted that Fossum et al. uses a CMOS 
circuit for their read-out circuit (Column 5, Lines 12-22). It would have been obvious to 
one of ordinary skill in the art at the time the invention was made to use the 
photodetector array of Fossum et al. to be able to individually choose the proper 
material for both the photodetector array and read-out circuit. 

33. Claim 18 is rejected under 35 U.S.C. 103(a) as being unpatentable over Wilder et 
al. (US 5,262,871 ) in view of Chao et al. (US 5,21 6,484). 

[claim 18] 

34. In regard to claim 18, Wilder et al. discloses a system, which meets the 
requirements as set forth in claim 1 as discussed above. Therefore, it can be seen that 
Wilder et al. lacks a system wherein said computer system is capable of determining the 
spectral signatures of said target object. Chao et al. discloses a real-time imaging 
spectrometer with an image sensor and computer which is capable of determining 
spectral signatures of objects for the purpose of remote observation and sorting of 
materials (Column 3, Lines 55-60; Figure 1). It would have been obvious to one of 
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ordinary skill in the art at the time the invention was made to combine the functionality of 
Chao et al. with the image sensor and computer system of Wilder et al. to allow Wilder 
et al. to determine spectral signatures for the purpose of remote observation and sorting 
of materials. 



35. The declaration filed on March 8, 2004 under 37 CFR 1 .131 is sufficient to 
overcome the Yang et al. reference. The previous rejections under 35 U.S.C. 102(a) 
and 35 U.S.C. 103(a) are therefore withdrawn. 



36. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Timothy J Henn whose telephone number is (703) 305- 
8327. The examiner can normally be reached on M-F 7:30 AM - 5:00 PM, alternate 
Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wendy R Garber can be reached on (703) 305-4929. The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 



Response to Amendment 



Conclusion 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



TJH 

5/6/2004 




